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ABSTRACT 



A transmitter of three-dimensional skeleton structure 
motions in which motion data of a skeleton structure in 
three-dimensional computer graphics (CG) is transmitted 
from a transmitting end to a receiving end to create at the 
receiving end animation data based on the transmitted 
skeleton structure motion data. The transmitter can transmit 
element motion data as time series data in which the element 
data is accompanied by connection methods, transmit initial 
information as CG animation data, and transfer CG anima- 
tion data from a transmitting end computer to a receiving 
end computer. 

8 Claims, 12 Drawing Sheets 
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Fig.12 



STEPjl set right hand tip right forward of face (set starting point) 

STEP_2 set right hand tip a little upper left (sub-three-dimensional virtual space 
X direction 2, Y direction 3) 

STEP_3 specify right hand finger shape (open a hand, no twist) 

STEP_4 set movement matrix of sub space 

STEP_5 set starting time 

set control point 

STEP_n set right hand tip left forward of waist (set end point) 

STEP_n+1 set right hand tip a little upper (sub-three-dimensional virtual space 
Z direction 1) 

STEP_n+2 set end time 
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Fig.13 
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TRANSMITTER-RECEIVER OF 
THREE-DIMENSIONAL SKELETON 
STRUCTURE MOTIONS AND METHOD 
THEREOF 

This application is a continuation of application Ser No. 
09/243,504, filed Jan. 26, 1999, now U.S. Pat. No. 6,222,560 
which was a continuation of application Scr. No. 08/842 
529, filed on Apr. 24. 1997. 

FIELD OF THE INVENTION 

The present invention relates to transmitter-receiver of 
three-dimensional skeleton structure motions and its 
method, which efficiently transmits/receives natural motions 
of a character having a complex skeleton structure, e.g.. 
human beings, when producing or commercially utilizing 
three dimensional computer graphics (3DCG) based on 
network, e.g., internet. 

BACKGROUND OF THE INVENTION 
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As a 3DCG application, virtual malls on internet, e.g., 
WWW (world wide web) and various homepages have been 
noticeable. Particularly, the rapid developments of internet 
helps to improve the circumsuoces in which 3DCG of such 
as games and movies are readily handled at home. 

In a conventional WWW, a machine called "server," such 
as a pcrsooal computer (PC) and workstation, k connected, 
through internet, to a plurality of machines called "client," 
such as PC. In response to the demand of a client, as 
required, data including information on picture image, 
voice, text and layout provided by a server is downloaded, 
and then reconstructed at the client side to obtain necessary 
information. In such communication between servers and 
clients, there is utilized a communication procedure based 
on TCP/IP (transmission control protocol/internet protocol). 

Conventional data provided by servers were mainly text 
data and picture ♦toige data. Recently, the standardization of 
VRML (virtual reality modeling language) and the browser 
of the VRML advanced, and the modern trend is toward the 
transfer of 30CG data itself, such as shapes and scenes. 

Brief description will be given of the VRML. To transfer 
picture data, particularly moving picture data using a con- 
ventional data format mainly for picture image and text, e.g., 
HMTL (hyper text markup language), requires much trans- 45 
fer time and costs. Therefore, network traffic restriction is 
imposed on the present-day system. In a conventional 
3DCG, shape, viewpoint and lighting information were all 
processed by three-dimensional data. As computer graphics 
(CG) technology is advanced, the image quality of picture 50 
image created by CG is rapidly improved. In view of data 
quantity, it is more efficient to transfer CG data as it is. In 
this case, data compression ratio is normally not less than 
1/100 of the transfer of the equivalent picture image data. 
Therefore, the modern trend is toward the standardization of 55 
the transfer method of 3DCG data through network. As an 
attempt, the standardization of 3DCG data called "VRML" 
has been proposed (VRML Ver. 2.0). The VRML Ver. 2.0 
defines, for example, shape data called "primitive,'* data 
format of various lighting source data, viewpoint data and 
texture data, and the designation process of rigid body 
motion. 

Among the conventional CG field, animation that pro- 
duces picture image in real-time, i.e., so-called real 
animation, is worthy of remark. The reproduction of the real 
motion of CG characters utilizing a real animation, is being 
studied mainly in the field of CM (commercial message) and 



movies. There are for example a method called "kinematics 
method" in which a complex shape such as human being is 
represented by a skeleton structure (hierarchical structure), 
and its complex motion is reproduced naturally by the' 
5 definitions of the motion quantity of the joints of skeletons 
thai change from time to time. 

The aforementioned kinematics method was primarily 
developed in the field of robotics engineering. This method 
is to decide the posture of a skeleton model having a linear 
10 link structure comprising links and joints, by setting the 
angle of rotations in the directions of X, Y and Z axes of the 
joint parts of the skeleton model, and the motion quantity 
(position) in the directions of X, Y and Z axes. 

By utilizing the kinematics method in a character of an 
15 arbitrary skeleton structure created by CG, it is being able to 
decrease the data quantity and reproduce natural motions of 
such as human being and dinosaurs, compared to a conven- 
tional polygon based animation that is created by the simul- 
taneous use of key frame method and the like. 
20 In 3DCG modeling language 00 a conventional internet in 
which VRML plays a central role, however, it is present 
condition that 00 consideration is given to methods for 
defining continuous time series motions of objects, and that 
there is no method for defining the motions of complex 
25 shapes of human being and the like, i.e., natural postures of 
hands and feet. 

Id a conventional animation creation based on kinematics 
method, the creation of smooth motions requires much 
motion data. In terms of applications to network, traffic issue 
is left unsettled. 
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SUMMARY OF THE INVENTION 
It is an . object of the present invention to realize that 
between clients and servers being connected od internet, 
complex shapes (avatar) of such as human being having a 
skeleton structure (hierarchical structure) and motion data 
serving as the base of the avatar are transmitted/received, 
and the avatar is then interactively operated witopacb other 
in three-dimensional virtual space 00 network. 

Other objects and advantages of the present invention will 
become apparent from the detailed description given here- 
inafter; it should be understood, however, that the detailed 
description and specific embodiment are given by way of 
illustration only, since various changes and modifications 
within the scope of the invention will become apparent to the 
those skilled in the an from ibis detailed description. 

The present inventors have found out that the above 
objects can be attained -by the following facilities: 

(i) a mechanism for defining a complex structure of such 
as human being by a skeleton structure, compressing, 
restoring and transmitting/receiving the reference posi- 
tion (hereinafter referred to as "root") of a specified 
skeleton and the motion information of each joint 
position of the skeleton; 

(ii) a mechanism for disassembling the motion data of the 
skeleton structure to be added to an initial information, 
which comprises the hierarchical relationship of the 
skeleton structure, the initial stale of the skeleton 
structure, constraint of the skeleton structure (e.g., the 
degree of freedom of each joint rotation and the rota- 
lion range), shape data to be attached to skeletons and 
data relative to the attachment to the skeleton structure, 
into the representative element data of the motions in 
three-dimensional virtual space (hereinafter referred to 
as "basic motion"), transmitting/restoring the disas- 
sembled basic motions together with methods for con- 
necting the representative motions of the basic motions; 
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(iii) a mechanism for deciding the postures of necessary 
skeleton structures based on the transmitted/received 
animation information; and 
(tv) a mechanism for interactively altering, for example, 
the operations of motions sucb as the directions of 
motions and the stream of the basic motions, according 
to the instructions of users who operate based on the 
motions of avatars to be transmitted/received. 
In accordance with this finding, in transmitting/receiving 
three-dimensional motions of a character having a complex 
structure sucb as human being, it is possible to define a 
human hierarchy by a skeleton structure and the a transmit/ 
receive, in time series, the motion quantity of some joints of 
the defined skeleton structure in three-dimensional virtual 
space. It is also possible to add, into representative motion 
elements, connection methods thereto, and then transmit/ 
receive it. These enable to transmit/receive natural and 
smooth motions of characters in transmission/receiving sys- 
tem based on network, thereby considerably reducing the 
data quantity during the transfer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing a structure of a 
transmitter/receiver of three-dimensional skeleton structure 
motions according to an embodiment of the present inven- 
tion. 

FIG. 2 is a block diagram showing a structure of a CG 
animation data transmitting means. 

FIG. 3 is a block diagram showing a structure of a CG 
animation data receiving means. 

FIG. 4 is a diagram snowing a hierarchical relationships 
of human skeleton structure. 

FIGS. 5(a) and 5(b) are diagram showing a data format of 
a skeleton structure. 

FIG. 6 is a diagram for explaining a process for subdi- 
viding method of a skeleton structure motions. 

FIG. 7 is a diagram for explaining sub-three-dimensional 
virtual spaces of divided motions. 

FIG. 8 is a diagram for explaining how motion position is 
restored from the sub-three-dimensional virtual spaces of the 
divided motions. 

FIG. 9 is a diagram for explaining a process for changing 
into a joint angle when given sub-three-dimensional virtual 
spaces. 

FIGS. 10(a) and 10(b) are diagrams showing a method for 
mapping human basic skeletons and face shape. 

FIGS. 11(a) and 11(6) are diagrams for explaining con- 
nections between basic motions. 

FIG. 12 is a diagram of a stream for creating motion data 
from human motions. 

FIG. 13 is a diagram of a script expression of motion data 
of a CG skeleton structure. 

FIG. 14 is a diagram showing a process for transmitting/ 
receiving motion data of a CG skeleton structure. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

An embodiment of the present invention will be described 
referring to the accompanying figures. 

Referring to FIG. 1, a transmitter/receiver of three- 
dime osiocal skeleton structure motions according to this 
embodiment is one in which from a transmitting end, motion 
data of a skeleton structure in 3DCG is transmitted to a 
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receiving end, and animation is then created at the receiving 
end based on the transmitted motion data of the skeleton 
structure. The transmitter/receiver is provided with CG 
animation data transmitting means 1, CG animation data 
5 transferring means 2 and CG animation data receiving 
means 3. 

Referring to FIG. 2, the CG animation data transmitting 
means 1 is provided with skeleton structure defining means 
11, motion data defining means 12 and motion data element 

10 disassembling means 13. Depending on requirements from 
a receiving end, the CG animation data transmitting means 
1 is to add motion data of a skeleton structure to ao initial 
information and then transmit. Specifically, it is decided 
whether the motion data of a skeleton structure should be 

15 transmitted as time series data (hereinafter referred to as 
"transmission format I"X or the motion data of the skeleton 
structure should be disassembled into basic motions which 
characterize the motions in three-dimensional virtual space, 
so that it is transmitted as data in which the disassembled 

20 basic motions is accompanied with the connection method 
thereto (hereinafter referred to as "transmission format II"). 
Based on the decided transmission format, the transmitting 
means 1 is to add the motion data of the skeleton structure 
to the initial information, followed by its transmission. The 

25 initial information include hierarchical data for defining 
hierarchical relationships of the skeleton structure, the initial 
state of the hierarchy data, constraint of skeleton joints, 
shape data to be attached to the skeletons, data relative to the 
attachment to the skeleton structure, moving picture data 

30 stream that perform moving picture mapping of some of 
shape data, and mapping methods. 

Referring again to FIG. 1, the CG animation data trans- 
ferring means 2 is to transfer CG animation data, in which 
motion data of a skeleton structure is added to an initial 

3 S information, from the transmitting end computer to the 
receiving end computer by using a transferring program on 
the transmitting end and a receiving program on the receiv- 
ing end. 

Referring to FIG. 3, the CG animation data receiving 
40 means 3 is provided with skeleton structure defining means 
31, shape data corresponding means 32, motion data defin- 
ing means 33, posture deciding means 34, motion element 
data connecting means 35 and motion connecting means 36. 
The CG animation data receiving means 3 is to receive CG 
45 animation data transferred from the CG animation data 
transferring means 2; to distinguish the transmission format 
of the received CG animation data; to interpret an initial data 
and motion data of a skeleton structure which have been 
transmitted by the distinguished transmission format; and to 
so decide the posture of the skeleton structure according to 
kinematics. 

Specifically, when the transmission format is the trans- 
mission format I, the CG animation data receiving means 3 
is to interpret the initial information and the motion data of 

55 the skeleton structure transmitted as time scries data and 
then to decide the posture of the skeleton structure according 
to kinematics. On the other band, when the transmission 
format is the transmission format II, the CG animation data 
receiving means 3 is to interpret the initial information, and 

60 the motion data of the skeleton structure in which the 
connection process to the disassembled basic motion has 
been added to the disassembled basic motion, and then to 
decide the posture of the skeleton structure according to 
kinematics. 

65 Description will be given of the operation of the 
transmitter/receiver of three-dimensional skeleton structure 
motions. 
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The CG a nun alio a data transmitting means 1 decides, 
depending on requirements from the receiving end, as to 
whether it should be transmitted by the transmission format 
I or II and, based oo the decided transmission format, adds 
the motion data of the skeleton structure to the initial 
information, followed by transmission. 

Ax this time, the skeleton structure defining means 11 
defines, by a skeleton structure, a CG character as a trans- 
mission object having complex skeleton, e.g. human being, 
and then sets a root (reference position of calculation) to the 
top level parent position of the hierarchical structure of the 
defined skeleton structure. At this stage, for instance, human 
being has the skeleton structure as shown in FIGS. 4 and 
10(a). Its root is normally set in the center of gravity of the 
body, e.g. groins of feet, and the origin of a local coordinate 
system of a CG character (hereinafter referred to as "right- 
handed system of Z top) is placed there. 

In FIG. 4, parts surrounded by square are joints of a 
skeleton structure. Lines linking the joints correspond to 
portions of arms or feet, which arc called "link" or "seg- 
ment". Parts surrounded by ellipse axe tip portions of hands 
or feet, which are called "end site." FIG. 4 shows a basic 
skeleton. As required, the hierarchy of a skeleton structure is 
altered. For instance, when it is required to express in more 
detail the hierarchy of hands of the skeleton structure shown 
in FIG. 4, the hierarchies of fingers and thumb, and the joints 
contained in the hierarchies may be provided under wrists. 

In addition to the hierarchical relationship of the afore- 
mentioned joints, the hierarchical initial states are set to the 
skeleton structure. For instance, there are set initial direc- 
tions of the lengths of arms and legs. Further, the moving 
ranges of the joints are set to the skeleton structure. For 
instance, it is set that the right elbow is rotatable from a 
certain degrees to a certain degrees in the rotations X, Y and 
Z axes of the local coordinate system, respectively. 

Referring to FIG. 5(a), for human elbows, segments 
correspond to upper arms or forearms, parts called a site" arc 
present at both ends of the segment. For instance, the joints 
of the elbows are further defined as an upper arm site and a 
forearm site. 

Referring to FIG. 5(6), in the definition of a skeleton 
structure, each part name, e.g. "Neck and NeckBase," is 
added to segments, sites and joints, as an identifier. Three 
components of three-dimensional coordinate position "-p" 
or the angle of rotation M -r" are set to a site. In the coordinate 
of a site, the origin of a local coordinate is placed at the 
parent site of each segment. As to the joints, there are set 
identifiers such as "SkullBase" and hierarchical relationship, 
i.e., parentage M -c\ which indicates that a certain parent site 
connects to a certain child site. Further, a moving range "-1" 
(angle) and the degrees of freedom of rotation (e.g. for 
"Ball" rotations around X, Y and Z axes). 

The motion data defining means 12 sets the motion data 
of main parts of the skeleton structure set by the skeleton 
structure defining means U. The aforementioned main parts 
signify the skeleton parts required to move. For instance, 
when it is required to move the whole body, three- 
dimensional coordinate position or rotation data of the joints 
of the skeletons contained in the whole body, are given as 
time series data. The motion data format normally comprise 
time data such as frame numbers, and entity data. The time 
data and the entity data are respectively composed of the 
name of joints, identifiers for distinguishing, rotation data or 
position data, and three elements (compositions of X, Y and 
Z axes). 

The motion element data disassembling means 13 
disassembles, as required, motion element data into refer- 



ence points, motion passage information required for 
expressing the skeleton movement, based on the motion data 
stream of time series. The disassembling method will be 
described later. 

The CG animation data transferring means 2 transfers CG 
animation data in which an initial information is accompa- 
nied by motion data of a skeleton structure, from the 
transmitting end computer to the receiving end computer by 
using a transmitting program on the transmitting end com- 
puter and a receiving program on the receiving end com- 
puter. Specifically, according to TCP/IP, the skeleton struc- 
ture and the motion data compressed by the CG animation 
data transmitting means 1 are transferred between servers 
and clients. 

The CG animation data receiving means 3 receives CG 
animation data transferred from the CG animation data 
transferring means 2, distinguishes the transmuting format 
of the received CG animation data. For the transmitting 
format I, the means 3 interprets the initial information and 
the motion data of the skeleton structure being transmitted as 
time series data, to decide the posture of the skeleton 
structure according to kinematics. For the transmission 
format II, the means 3 interprets the initial information and 
the motion data of the skeleton structure in which the 
connection method of the disassembled basic motions has 
been added to the disassembled basic motion, to decide the 
posture of the skeleton structure according to kinematics. 

At that time, the skeleton structure defining means 31 
receives the human skeleton structure data to be defined by 
the skeleton structure defining means 11, and then interprets 
the received skeleton structure data. 

The shape data corresponding means 32 associates a 
certain segment of a skeleton structure as a processing object 
processed, with a certain part of shape data previously 
transferred. This shape data signify data relative to skin parts 
to be attached to the skeletons of a CG character. Normally, 
the shape data is a polygon stream or a set of mesh data. The 
polygon stream or the mesh data is classified into, for 
^ example, a group corresponding to upper arms and a group 
corresponding to legs. It is previously defined how the 
classified data group corresponds to the upper arms or legs 
of the skeleton structure. Normally, the correspondence 
between shapes. and skeletons is decided by positioning, at 
45 the parent site of the segment of the skeleton structure, the 
origin of a local coordinate system of the segment, and 
setting now much skin should be attached in which direction 
from the origin. The direction is designated by positioning 
vector and orientation vector. The segment of a skeleton is 
50 positioned in the center of gravity of a plurality of shape 
groups and attached to the minimum distance from each 
shape group. 

In order to show shapes naturally, it is necessary to set 
such that skin does not break at joint parts. This is realized 
S5 by setting a new shape group called "flexor" for the shape 
groups of the joint parts, setting, by weighting factor, the 
influences according to the bending angles from a parent 
segment and a child segment depending on the bending 
angles of the joint parts, to deform the shape groups con- 
tained in (be flexor. 

The motion data defining means 33 receives motion data 
transmitted from the motion data defining means 12 or the 
motion clement data disassembling means 13 and then 
restores the received motion data as necessary. 

The motion element data connecting means 35 connects 
smoothly basic motions of the motion data restored in the 
motion data defining means 33, with each other. 
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The posiuie deciding means 34 decides tbe postures of Wbeo tbe posture of a skeleton (the ran« of a ha^n « 

*ke le *ns at an arb.irary ume, us,ng *e skeleton suuaure solved from the position of the tip of the "Sfc bj Sv 

data &otn tbe skeleton structure defining means 31. the foe the inverse kiMmaties methnri hm fi« » • * m P' 0 >'' 

shape data ^uped by skeleton data from the shape data X^Zf™^ ^SS E < SE? < ?£ 

corresponding means 33, and the motion data from tbe < ck-i-m™ ln fhr _ , ~1 , P°srures ot ine 

inotiri^ 5 T l ? rc ^ mc 0510041 virtua space cannot be 

means 34 adds, as "necessary, the motin d£ in which tn! tTl j^'^f 0 ^ " 15 ""^ based 

basic motions transmitted from tbe motion clement data u 40 cva i u 1 at100 f^ 00 ( cocr S v minimization) by which 

connecting means 35 have smoothly been connected with C ^ , 106 square of microsco P lc c^oge quantities of ail 

each other, to decide the postures of the skeletons at an jowl ^ogles contained in a handle becomes a minimum, 
arbitrary time. 10 Specifically, calculated are joint angles employed in the 

The motion connecting means 36 connects the postures of J orwar d kinematics method and an inverse matrix of a 

the skeletons decided in the posture deciding means 34. determinant expressing the relationship of tip position. 

Description will be given of a method for deciding the * DIch 15 called " Jacobi matrixJ * * decided uniquely. In 

posture of a skeleton structure. mc MVcrac matrix, when the number of joints is N, it 

When deciding the posture of a skeleton structure shown 15 ^ mcs *_ mat ™ of 6*K wherein 6 denotes the maximum 

in FIG. 4 at an arbitrary time (frame), although it depends 00 grT * , u*tdom. Since no inverse matrix exists as it is. 

motion data format, there is basically employed kinematics p ™i Jacobl l0VCn5C malnx 15 calculalcd b * sucn « sweep 

method that was primarily developed in the field of robotics mClDod t Uoder thc tforementtoned constraint (see Robotics 

engineering^, for example, Robot Dynamics and Control , wnlten by HlIDSC ' published by Shokabo). 
written by Arimoto, published by Asakura-shoteo). 20 . Io tDe P osturc deciding means 34, cither the inverse 

In tbe kinematics method, time variation quantity of the ^matics or »nc forward kinematics is used depending on 

angle data of each joint is given to an initial position of a and " 35 PM l ui » a - lnc decided by kine- 

joint structure connected by linear chain links to decide joint malKS * com P* red ^ * set moving range based on the 

positions of parents and then those of children, thereby moving ^ daU of an arbitrary joint to be input from the 

deciding the postures of the linear chains skeleton structure defining means 31, thereby placing 

In the case of a human skeleton as shown in FIG 4 it is resmaioos on &t postures of joints. After calculating the 

normally necessary to individually decide the respective y luDemimcs ' whco a certain joint angle exceeds 

postures of five linear chains which comprises the right and m °™ g raogC ' tbcrc L * added conditional judgment 
left feet tips from tbe root, the right and left hand tip* from 30 P ^ X f Sl f g '° * l * valuc obtaincd by ^ F**™ 

the root, and the head top from thc root (e.g., tbe right arm ° ™ 4 

and tbe right leg). Suppose that data from thc motion data lae P 0 ^* of 3 character having a skeleton struc- 

defining means 33 is the angle data of the respective joints. mrc can °* decided by employing the aforementioned kine- 

Generaily, since necessary angle data of the joints in FIG. 4 matics method. 

are all given to the posture deciding means 34, the positions 35 Description will be given of a method for affixing skin to 

of the respective linear chains are decided uniquely. As postures of skeletons. 

discussed above, a method for deciding the positions of As previously described, in 3DCG, skin data is a polygon 

skeletons by using an initial state of a skeleton structure and g rou P or a free-form surface group. Normally, tbe modeling 

angle data of joints at an arbitrary time, i.e., rotation angle of skin shape requires a general 3DCG modeling tool. The 
from an initial position in thc local coordinate system, is 40 output data format of this tool utilizes the standard formats, 

called "forward kinematics method." such as Dxf (the file format of the trade name Auto "CAD", 

In the forward kinematics method, the posturc deciding manufactured by AUTODESK Corp.) and Obj (tbe file 

means 34 performs calculations of the initial value data of format of the trade name "wave front", manufactured by 

skeletons input from the skeleton structure defining means Silicon Graphics In.). 

31, in the order of increasing distance from the root. For 45 'n the shape data corresponding means 32, a polygon 

instance, to pareot sites of the skeletons and the lengths of group is associated to a certain segment of a skeleton 

segments shown in FIG. 5, a rotation matrix (3* 4 matrix), structure defined in the skeleton structure defining means 31. 

which depends 00 tbe rotation angles of parent sites given by For instance, when tbe shape group of human upper arms 

the motion data defining means 33, is acted to decide the corresponds to thc segment of upper arms in skeletons, the 

positions of child sites. The operation for making the rota- 50 origin (e.g., thc position of center of gravity) of a modeling 

tion matrix act to tbe aforesaid parent sites and the lengths coordinate of tbe shape group is matched with the origin of 

of the segments is repeated as many as the number of joints. a parent site coordinate of the segment, and then tbe fine 

As a posture deciding method other than the forward adjustment of location relationship is performed using offset 

kinematics method, there is inverse kinematics method. In ^ om tQe matched point (three compositions in the directions 

the inverse kinematics method, it is necessary to set a range 55 °^ X, Y and Z axes) and tbe scale of the shape (enlargement 

of calculating in a skeleton structure, Lc, tbe range of the rauo m thc directions of X, Y and Z axes), 

effect of skeleton movements, which is called "handle." In By deciding the postures of the skeletons using kinemat- 

F1G. 4, a handle is set, for example, from the right nape to ICS method, the position and direction of a parent site of a 

the right band tip. To this handle, time series data of the target segment are decided. Therefore, by allowing the 

position of the tip of the handle (the right hand tip in this 60 moving rotation matrix as described above to directly act on 

example) in three-dimensional virtual space is given. shape data of the group corresponding to each segment (top 

Although the position data can be set by thc maximum six coordinate of the polygon), skin moves in association with 

elements of three-dimensional coordinates (X, Y and Z axes me motions of skeletons. 

compositions) and rotational angles (rotational compositions In the above described manner, thc animation of a CG 

around X, Y and Z axes) of the tip, normally, either of the 65 character having a basic skeleton structure is created, 

three compositions are separately given to the posturc decid- In tbe foregoing example, the motion data is angle data of 

ing means 34. joints in the forward kinematics or position data of a lip 
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portioo in the inverse kinematics. Further, time series data of 
the angle data of the joints and the position data of the tip 
portion are required to subsequently input from the motion 
data defining means 33. 

Generally, in a transmitting/receiving system of the CG 
animation data that is connected to internet, as shown in 
FIG. 1, it is accessary to minimize communication traffic in 
the CG animation data transferring means 1. 

Description will be given of a compression method of 
motion data. 

It is necessary that compression rate can be controlled 
hierarchically according to plot capability of transmitting/ 
receiving end machines. 

Referring to FIG. 6, CG character motion data is decided 
by information (i) the motions of joints of a skeleton 
structure; and (ii) the positions of the entire body in three- 
dimensional virtual space, and direction data. Here mailer, 
the former will be called "local information" and the latter 
will be called "world information.** 

In normal CG character animations, the world informa- 
tion is defined as root information of the skeleton structure 
shown in FIG. 4, and the local information is defined as joint 
information. Firstly, a three-dimensional virtual space sur- 
rounding a moving range of a CG character as shown in FIG. 
6, is estimated. The reference coordinate of the three- 
dimensional virtual space is matched with the root position 
of the skeleton structure (the position of a human spin base 
in FIG. 6\ and then the origin of a local coordinate system 
is set. With respect to the origin of the local coordinate 
system, a virtual action space in the directions of X, Y and 
Z axes is seL The whole size of the virtual action space is 
decided by setting the dimensions in the directions of X, Y 
and Z axes. The move of the virtual action space in the world 
coordinate system in association with the move of the body 
can be defined by the translating trace and rotational matrix 
of the character. The virtual action range will be rotated or 
removed according to the move of the CG character, i.e., 
world information. Qualitatively, the virtual action range is 
the maximum range in which the hands and legs of a CG 
character can move in the local coordinate system. Although 
a rectangular paralle loptped is exemplified as a virtual action 
space in FIG. 6, a sphere centered with respect to a CG 
character may be selected. In this case, it is preferable that 
a division as described later is given in a polar coordinate 
system. 

Secondly, sub- three -dimensional virtual spaces that 
divide the three-dimensional virtual space are estimated. 
The sub-three-dimensional virtual spaces are for uniformly 
subdividing the virtual action space, and its size decides the 
number of quantizations by dividing pitches of dx, dy and dz 
in the directions of X, Y and Z axes in the local coordinate 
system, or the number of division (1, m, n) in the direction 
of X, Y and Z axes. 

In setting the motion of a CG character in three- 
dimensional virtual space, it is required to set joint positions 
or the position of a tip position of a skeleton structure. The 
position is defined by an identification number or a coordi- 
nate position of a sub-three-dimensional virtual space. By 
setting the dividing pitch of the sub-three-dimensional space 
greater, the quantization level of each joint position or a dp 
position of a skeleton structure will be lowered, resulting in 
reduced data quantity. 

The sub-three-dimensional space is further divided hier- 
archically and then synthesized depending on hardware of 
the transmitting/receiving ends or the performance of a 
transferring system, as shown in FIG. 7. To code a cootinu- 



10 

ous motion position of a CG character in a three- 
dimensional virtual space, the control points of the motioa 
in three-dimensional virtual space shown in FIG. 8 are 
designated by a sub-three-dimensional virtual space. 
Requite information for reproducing motion include the 
position (or identification number) of a sub-three- 
dimensional virtual space at a starting point of the motion, 
the position (or identification number) of a sub-three- 
dimensional virtual space at the end point, and information 
of interpolation method, e.g., linear interpolation and spline 
interpolation, between the starting and end points of the 
motion. As increasing the information of the control points 
shown in FIG. 8, the motion is reproduced smoothly, which, 
however, increases the data quantity. When the identification 
number is given, the conversion into a coordinate in three- 
dimensional virtual space at the receiving cod, is performed 
by using, for example, the position of gravitational center of 
a sub-three-dimension virtual space and the relative position 
from the origin of a local coordinate. In this case, there 
occurs a quantizing error of the size of one sub-three- 
dimensional virtual space. 

The flow of the aforementioned data in the transmitting/ 
receiving system of the skeleton data of the CG character 
shown in FIG. 1 will be summarized. Firstly, in the motion 
element data disassembling means 13, the position and the 
moving rotation matrix expressing the direction (world 
information) in the world coordinate system in three- 
dimensional virtual space, the size of a virtual action space 
as shown in FIG. 6, and the dividing pitches (dx* dy, dz) into 
sub^hreeKhmensional virtual spaces are transferred to a 
target CG character. Then, the positions or the identification 
number of sub-three-dimensional virtual spaces at starting 
and end points of three-dimensional position in which the 
skeletons of arms and legs move, the sub-space position of 
the control points or the control point information, and a 
method of connecting the starting and end points of the 
three-dimensional position arc transferred as motion data, by 
the unit of an arm and a leg of a CG character, as required. 
In the motion data clement connecting means 35 at the 
4Q receiving end, the transferred data is interpreted (restored), 
and the three-dimensional position of the CG character 
shown in FIG. 6 is then interpolated to reproduce the motion 
of the CG character. 

For simplification, the above description is provided on a 
method in which only the position of the tip portion is set. 
Likewise, when a posture is decided utilizing the forward 
kinematics in the posture deciding means 34, angle infor- 
mation obtained from the control positions of all the joints 
of necessary skeletons may be transferred as information of 
sub-three-dimensional virtual spaces. 

FIG. 9 shows a method for obtaining joint angle data at 
the transmitting or receiving end when sub-three- 
dimensional virtual spaces are given to the posture deciding 
means 34. 

Referring to FIG. 9, an initial position of a joint position 
(the center position of a sphere in FIG. 9) is set in the 
skeleton structure defining means 11 and the skeleton struc- 
ture defining means 31. When a position of a sub-three- 
dimensional space at a certain time, or an identification 
number is given to the posture defining means 34, the 
gravitational position coordinate of the sub-three- 
dimensional space can be calculated. Based on the position 
in the sub-three-dimensional virtual space or an identifica- 
tion number, the dimension of a sub-three-dimensional a 
65 virtual space, and the length of a segment that has been 
known, the rotational angles (Ox, 9y, &z) around the respec- 
tive axes in the local coordinate system arc calculated. In 



30 



35 



45 



50 



55 



60 



09/26/2002, EAST Version: 1,03.0002 



US 6,388,670 B2 

" 12 

this case the order of the rotations (e.g., X-Y-Z) should be for connecting these basic actions, it is accessary to set 

previously decided. information oo how much it goes in the negative time 

When a posture is decided utilizing the inverse kinematics direction of the basic action (A) (a value in the negative time 

in toe posture deciding means 34, in the CG animation data direction, e.g., tl') and information on how much it goes in 
transmitting means 1, handle information of a skeleton 5 the positive time direction of the basic action (B) (a value in 

structure and the position information of the tip position of mc P 05 ^ 6 tin* direction, e.g., t2'). Such a set value may 

skeletons are transferred from the motion element data navc a nxcd valuc 45 default at the transmitting/receiving 

disassembling means 13. eod - Based on these information, interpolation processing is 

la tbe foregoing description, information oo distortions of X^^S'S^T 1\° d dp 

skeletons. i.e. tbe rotations around Z axis in thefoca "> T^J- ' 'h? a ? d , t2 "°- U{b) - AWl0M * b 

coordinate sysfcm, is not defined e»ctry In a JL w£reU* '«?' c « ed f b > « rel « » FIG - S"*rally have three 

j „, , ' ^T' f „/. a case woe re toe compositions of X. Y and Z axes, one compos t on alone is 

degree of freedom of a joint is "Ball" m the definition of Unrated here for the sake of simplification. 

ro S&IfktaL alTvVaSi J* 7? Wbe ° ^ * * metbod for plating tr^e points, information on 

Z\ k a-^S? J T?a . ^ ^ «ound Z such as linear interpolation or spline interpolation is preset 
£ ^ Jd ^"» n ' s « s f t ncted. In human bemg " „ transmitting/receiving ends. For Tmore smooth 

^ n H^«, £ d TT °l J ° U " S ° f S o Ch 45 hip - «*««*». sub-three^imensional virtual space information 

ufa CG cZS-TT y ^ T P^ 1 " 1 * * interpolation information is transferred between 

in a CG character. ts necessary to precisely express as to times tl and t2 (see a point between times tl and (2 in FIG 

whether wnsts are turned up. In this case, distortion U(f>). 

information, i.e.. the rotation ancle around Z axis should he 20 — , ... . , 

,aa.a i« ik. 7..t! ,k j- , ' , The above illustration refers to a case in which the posture 

added to tbe sub-three-dimensional vir ual space „f .t, „. ;„ _^„„ , j 

information, the resulting information is then transmuted/ S'tT t " *' """iS d , eCldmg ffle *** 34 

received. For instance, in tbe illustration in nSu$ 1,1^ ' DVene i klDen >«" s « "'^ng 

distortion angle 6 0 of a wrist a. rime «, and dttortiou angle £ ^h^h ^ MC \H mfonn,mon 15 T 10 

n .i . , •„ a, • * . ™«»«w>u «is» the posture deciding means 34, but tbe connection of the 

o, at tune t, are transmitted/received and, among mint 25 k.cv. „-..«„» ;« i ■ • , . 

. „ f . • , . ■ .. _ j Ttr 6 Dasic actions is performed on the same principle as the 

angles of skeletons decided in the posture deciding means inverse kioemaiicTnietbod 

34, only portions requiring distortion are replaced with angle n„ i „- .u c . ' , . 

data subjected to tbe interpolation between 8 0 and 6,. rf^T*?* ^ 1 y conne « ln 8 • P 1 "" 1 ^ 

iwJnZT m ii k. f . ° 1 . of baac *«lw>ns win one another based on a plurality of 

Description will be given of a method for connecting basic actwns transferred previoiisly and merely transmirtina 

r^Z^t'^^rAT^^'^ «*» soa« information and Jin"™* 

n^J^:^^^ , ^^^° - * t ^ bM !!; info'niation. a new action whose basic action has been 

T^n^^lZ^ ^T^*™* ch »8 ed «*° ^ created with considerably .ess data quantity. 

a virtual ^o„ space in the center of the body, and ,Ln » KS^ST^'SS ^ P ° UI,S " ' 

moves to a virtual action space at the upper right; and (B) -n. u ■ c ~. T 

motion in which a band moves from a virtual action space , aCU ? n ° f ' CG cbaracter '» » three-dimensional 

a. the upper right to a vertical action space in the front of the Z * cl " slfi u ed - l . as d ™f d *«»«. in, ° tbe ««« 

uitormaiion, i.e., in which part of three-dimensional virtual 

utr Mr„\ ic , a: c i • 40 space and a long which position a targe tCG character moves; 

bas7c m Sol ^^^^^^conneaionof two aod thc local ^0^^. i.e., which posture (position) the 



n c r-r^ v • Dands 4Dd of * tar 8 ct CG character takes at a certain 

Referring to FIG. 11(a), it is provided that the motion time on the position of the CG character. The former is 

from time tO to tl corresponds to the motion (A), and the de6ned by translation quantities (Xtrans, Ytrans, Ztrans) of 

motion from time t2 to t3 corresponds to the motion (B). The 4S the root of the skeleton structure shown in FIG 4 at an 

motion element data disassembling means 12 disassembles arbitrary time and the orientations (Xrot, Yrot Zrot) The 

the motion into virtual action space information and then latter is defined by the rotations (Xrot, Yrot Zrot) of each 

transfers sub-threeKumensional virtual space information of joint or the tip portion, or three<iimensional coordinates 

the starting and end points, and, as required, sub-three- (Xtrans, Ytrans, Ztrans). These information are sent from the 

dimensional virtual space information of control points 50 transmitting system to the receiving system as time series 

between thc starting and end points, together with thc data or the aforementioned virtual action space information 

mterpolatwn method. In tbe CG animation data receiving (q setting the basic action itself, normally used is tech- 

^^; h ^ &00 ooniiBCting means 35 interprets oiquc called "motion capture." A method for creating action 

ttie sub-three-diiMnswnal virtual spaces to restore the posi- data utaizing ^ mtioa mre ^ bc dl5CUSScd * 

tion information of each basic action. Further in the motion (t ,„ , A \_ . , 

nTES L f - _ . u ■ UkeQ ^ a P luralil y of ««™ b «°8 Ejected to a 

RG. U(6) shows a state m which tbe oormai basic actions desired motion. Based on the secondary picture image of the 

are connected with each other on the basis of time region. marker taken by two or more cameras, (he threcKlimensional 

Referring to FIG. 11(6), the end point position of the basic 60 coordinates of tbe marker or the angle data obtained by 

action (A) can bc restored from the action space information associating the skeleton structure is calculated (see for 

at time tl. The graph of FIG. 11(b) shows a case where the example Japanese Patent Application No. 7-312005(1995)). 

restored basic actions are converted into the position of the The motion of a CG character subjected to the motion 

end site of the right hand joint (the lip of the right hand) or capture is obtained as angle data (time series) of joints of the 

joint angle data. Similarly, the angle of the right hand tip or 65 skeleton structure shown in FIG. 4. Such data correspond to 

the coordinate value at time t2 can be restored from the the position 1 of the movement from time tO to tl, or the 

action space position at time t2. As connection information position 2 of thc movemeot from time t2 to t3. 
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It is a bisic method for tfarjsautung/ receiving motion data 
that the angle data of each joint of the skeleton structure is 
scot, as a basic action, transmitted from the motion data 
defining means 12 to the CG animation data transferring 
means 2 as time series data, to be interpreted in the motion 
data defining means 33. 

In the case where the motion data quantity is desired to be 
reduced, there is a method in which the control points 
information on a position is sampled and then the sampled 
information is transmitted/received together with its con- 
nection method. 

In the case where the transmitting/receiving data is 
required to be reused, the data should be disassembled into 
a virtual action space data shown in FIG. 6. In this case, 
based on the position data subjected to the motion capture, 
the motion element data disassembling means 13 quantizes 
(vector quantization) into the virtual action space of the CG 
character in FIG. 6, and then disassembles into the virtual 
action space data positions and identification number. The 
motion element data connecting means 35 restores, from toe 
received virtual action space data, the motion position 
subjected to the motion capture by utilizing the connection 
method information. 

Brief description will be given of a method for creating 
motion data without using the motion capture and the like. 

The skeleton structure of the CG character in FIG. 6 and 
a virtual action space are set. An initial state of the CG 
character is as shown in FIGS. 10(a) and 10(b). The virtual 
action space is divide into sub-three-dimensional virtual 
spaces and the obtained sub-three-dimensional virtual 
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As a method for reducing the data quantity, one in which 
the shape of a hand is fixed and a desired shape data is 
replaced as required, will be discussed Firstly, as shape data 
to be bound to the joints of the right and left hands of the 
skeleton structure in FIG. 4, shapes in which the band is for 
example opened or grasped are previously prepared. As 
shown in FIG. 11(6), when the motion of the right hand is 
given, the motion element data disassembling means 13 
adds information on distortion and the land of the shape data 
to be bound to the wrist and then transfers that information 
together with the sub-three-dimensional virtual space infor- 
mation. The motion element data connecting means 35 
restores the position of the motion using the sub-three- 
dimensional virtual space information and, at the same time, 
judges the distortion of the wrist and the shape to be bound 
to the wrist. Base on the judgment, the display of the results 
are switched, enabling to precisely reproduce the shape of 
the band tip. 

Description will be given of a method for representing 
expressions that is significant in reproducing a CG character. 

For a real representation of expressions, it is possible to 
bind a bead shape to the joint that corresponds to the neck 
of the hierarchy shown in FIG. 4, but it is difficult to 
reproduce the expressions of such as "being laughing' 1 
"being angry." Therefore, expressions is treated by a method 
for mapping a real moving picture to a face shape. 

Referring to FIGS. 10(a) and 10(b), when performing 
mapping, the shape of a bead is typically sphere or cylinder 
and, as required, shape data reproducing the irregularity of 



ana tac ooiamea suD-inree-aimensionai virtual auu » required, snape aata reproducing tne irregularity of 
spaces are then designated by identification number and the 30 * facc is employed. To this shape data, the mapping coor- 
like. dinale or the 



Referring to FIG. 12 illustrating a simple setting of the 
right band posture, the starting position of the right band tip 
is decided. For instance, when the storing point is the right 
forward of the face, the number of a sub-three-dimensional 
virtual space in the neighborhood of the right forward of the 
face is set (STEP 1). The result is displayed by deciding the 
posture of the right hand utilizing such as the inverse 
kinematics method. In this case, kinematic and display 
system are required as a simple browser. When the position 
of the right hand does not agree with the desired position, the 
step number of a sub-three -dimensional virtual space of the 
direction of X, Y and Z axes that are required to be removed, 
i.e., the local coordinate system, from the present block 
number or position, thereby setting a new sub-three- 
dimensional virtual space (STEP 2). By repeating STEP 2, 
the desired position can be seL The advantage of this 
designation method is that a rough position can be set in a 
manner in which a person arranges the action, such as M a 
little right'* and "a little rear/* Such a designation is set with 
respect to the sub-three-dimensional virtual space of neces- 
sary starting position, end position and the control points 

(STEP n, STEP o+l ). 

The forgoing description was primarily given of the 
setting of skeleton motions. Actual requirement as a CG 
character is skin information bound to the aforementioned 
posture of the skeletons. As previously discussed, the seg- 
ments of skin shape and skeletons can be assigned by 
sharing the local coordinate positions. In the kinematics 
method, it is necessary for a skeleton to be set to a portion 
that is required to move. Normally used hierarchy relations 
of skeletons is shown in FIG. 4 or FIG. 10. In the cases 
where the shape of human finger tips are desired to be set, 
e.g., an opened hand and a bent finger, the skeleton of the 
fingers may be defined in the same manner. However, a mere 
definition of the skeletons of the fingers will increase data 
quantity. 
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dinate or the mapping method in which the projection is 
taken into consideration is set. Further, taking into considr 
eraubn the cases where the neck will rotate in the directions 
of right, left and the like, there are prepared moving picture 
streams, i.e., MPEG2 (Motion Picture Experts Group phase 
2) being compressed image, of expressions when a human 
face is viewed from a plurality of camera positions, which 
is normally along a circle surrounding the face. When the 
direction of the neck is decided, it is determined from which 
moving picture stream the mapping data (which depend on 
the viewpoint) of the expressions is selected and, as 
required, from plural moving picture streams, the corre- 
sponding pixels of image data of corresponding time based 
on a plurality of motion picture stream are weighed from an 
angle of view point. For instance, the viewpoint observing a 
CG character is present between the points A and B shown 
in FIG. 10(6), A and B are selected as moving picture stream 
data, to decide the weight, which is proportional to the 
difference, depending on the gap in angles when the center 
of gravity of the character is viewed from the viewpoints of 
A, B and a viewpoint. 

The CG animation data transmitting means 1 calls for a 
mechanism for transferring moving picture streams of 
expressions compressed by for example MPEG2, and cam- 
era positions. The CG animation data receiving means 2 
calls for a mechanism in which the compressed moving 
picture streams thus transferred is restored and then judged 
to which viewpoint an image belongs, depending on the 
camera positions, followed by mapping. For further details 
of the method for mapping moving pictures, sec Foley & 
Van Dam et al.. Computer Graphics Principles and Practice 
II. Addison Wesley. 

FIG. 13 illustrates an example of script notation of motion 
with respect to three handles of the right hand, the left hand 
and the head. 

Referring to FIG. 13, the numbers of sub-three- 
dimensional virtual spaces of starting, end and control points 
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are set as position information, and a real reproducing time 
is transferred as addition information. In this example, spline 
is designated as interpolation method. 

FIG. 14 illustrates an example of a method for 
transmitting/receiving motion data of a CG skeleton struc- 
ture. 

Referring to FIG. 14, the transmitting/receiving of the 
substance of the motioa data represented in a sub-three- 
dimensional virtual space and the description language of 
the motion as shown in FIG 13, between the CG animation 
data transmitting means 1 and the CG animation data 
transferring-mcans 2, realizes the transmitting/receiving of 
CG animation data without depending on hardware, e.g., 
various calculations, performances of such as rendering, and 
OS (operating system). 

Brief description will be given of a method for performing 
collision check between two CG characters when a plurality 
of CG characters exist. 

As shown in FIG. 6, one of the advantages of representing 
motion in a sub-three-dimensional virtual space is to sim- 
plify the calculation of the collision check. For instance, 
when it is roughly checked whether one arm of a character 
collides one arm of the other character, firstly, the boundary 
of segments contained in a target arm of either character is 
estimated. Suppose that the boundary is a rectangular par- 
allelopiped that is decided by parent and child sites of the 
arm of the skeleton structure shown in FIG. 4. The base area 
of the rectangular parallelepiped is decided by the size of 
skin. That of human being is normally a fixed value accord- 
ing to physique. To check the collision between the bound- 
ary and the sub-three-dimensional virtual space (rectangular 
parallelopiped) of the other character, enables a simple and 
rough check. When required a further detailed check, the 
collision check of shape data contained in the above bound- 
ary (all the tops of polygon groups) may be performed. The 
collision check in the sub-three-dimensional virtual space, 
i.e., inner and outer checks between the boundary and a 
target point, realizes a great simplification (high speed 
processing) of the calculation of collision check. 

What is claimed is: 

1. A transmitter of three-dimensional skeleton structure 
motions in which motion data of a skeleton structure in 
three-dimensional computer graphics (CG) is transmitted 
from a transmitting end to a receiving end to create at the 
receiving end animation data based on the transmitted 
skeleton structure motion data, the transmitter comprising: 

(1) means for transmitting element motion data as ti™ 
series data in which the element data is accompanied by 
connection methods thereto, and for transmitting initial 
information as CG animation data; and 

(2) transferring means for transferring the CG animation 
data from a transmitting eod computer to a receiving 
end computer. 

2. A recording medium having recorded thereon a trans- 
mitting program of three-dimensiooal skeleton structure 
motions for transmitting morion data of a skeleton structure 
in three-dimensional computer graphics (CG) from a trans- 
mitting end to a receiving end and for creating at the 
receiving eod animation data based on the transmitted 
skeleton structure motion data, the transmitting program 
comprising: 

(1) means for transmitting element motion data as time 
series data in which the element motion data is accom- 
panied by connection methods thereto, and for trans- 
mitting initial information as CG animation data, the 
initial information including hierarchy data; and 
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(2) means for transferring the CG animation data from a 
transmitting end computer to a receiving cod computer. 

3. A transmitter of three-dimensiooal skeleton structure 
motions by which motion data of a skeleton structure in 
three-dimensional computer graphics (CG) is transmitted 
from a transmitting end to a receiving end to create anima- 
tion data at the receiving end based on the transmitted 
skeleton structure motion data, the transmitter comprising: 

(1) means for transmitting element motion data as lime 
series data in which the element motion data is accom- 
panied by connection methods thereto, and for trans- 
mitting initial information as CG animation data, the 
initial information including hierarchy data; and 

(2) transferring means for transferring the CG animation 
data from a transmitting end computer to a receiving 
end computer. 

4. A recording medium having recorded thereon a trans- 
mitting program of three-dimensional skeleton structure 
motions for transmitting motion data of a skeleton structure 
in three-dimensional computer graphics (CG) from a trans- 
mitting end to a receiving end for creating at the receiving 
end animation data based on the transmitted skeleton struc- 
ture motion data, the transmitting program comprising' 

(1) means for transmitting the element motion data as 
time series data in which the element motion data is 
accompanied by connection methods thereto, and for 
transmitting an initial information as CG animation 
data, the initial information including hierarchy data, 
and 

(2) means for transferring the CG animation data from a 
transmitting end computer to a receiving end computer. 

5. A receiver of three-dimensional skeleton structure 
motions in which data of a skeleton structure in three- 
dimensional computer graphics (CG) is transmitted from a 
transmitting end to a receiving end to create at the receiving 
end animation data based on the transmitted skeleton struc- 
ture motion data, comprising: 

receiving means for receiving the CG animation data from 
the transmitting end and, for a first format, for inter- 
preting initial information and time series data to 
decide the posture of the skeleton structure according to 
kinematics and, for a second format, for interpreting the 
initial information and the data in which the element 
data is accompanied by the connection methods thereto 
to decide the posture of the skeleton structure according 
to kinematics. 

6. A recording medium having recorded thereon a receiv- 
ing program of three-dimensional skeleton structure motions 
for receiving data of a skeleton structure in three- 
dimensional computer graphics (CG) transmitted from a 
transmitting end to a receiving end and for creating at the 
receiving end animation data based on transmitted skeleton 
structure motion data, the receiving program comprising: 

means for receiving CG animation data from the trans- 
mitting end and, for a first format, for interpreting 
initial information and time scries data to decide a 
posture of the skeleton structure according to kinemat- 
ics and, for a second format, for interpreting initial 
information and data in which element data is accom- 
panied by connection methods thereto to decide the 
posture of the skeleton structure according to kinemat- 
ics. 

7. A receiver of three-dimensional skeleton structure 
motions in which motioa data of a skeleton structure in 
three-dimensiooal computer graphics (CG) is transmitted 
from a transmitting end to a receiving end and to create at 
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the receiving end animation data based on the transmitted 
skeleton structure motion data, comprising: 

(1) transferring means for transferring the CG animation 
data from a transmitting end computer to a receiving 
end computer by a receiving program on the receiving 5 
end computer, and 

(2) receiving means in which the CG animation data from 
the transmitting end is received, and, for the first 
format, for interpreting initial information and time 
series data is interpreted to decide the posture of the 10 
skeleton structure according to kinematics and, for the 
second format, for interpreting the initial information 
and the data in which the element data is accompanied 

by the connection methods thereto to decide the posture 
of the skeleton structure according to kinematics. 15 
8. A recording medium having recorded thereon a receiv- 
ing program of three -dime nsiooal skeleton structure motions 
for receiving motion data of a skeleton structure in three- 
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dimensional computer graphics (CG) transmitted from a 
transmuting end to a receiving end and for creating at the 
receiving end animation data based on transmitted skeleton 
structure motion data, the receiving program comprising: 

(1) means for transferring CG animation data from a 
transmitting end computer to a receiving end computer; 
and 

(2) receiving means in which the CG animation data from 
the transmitting end is received, and, for a first format, 
for interpreting initial information and time series data 
to decide a posture of the skeleton structure according 
to kinematics and, for a second format, for interpreting 
initial information and data in which element motion 
data is accompanied by connection methods thereto to 
determine a posture of the skeleton structure according 
to kinematics. 
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